ART-Based Neuro-fuzzy Modelling Applied to Reinforcement Learning
نویسندگان
چکیده
The mountain car problem is a well-known task, often used for testing reinforcement learning algorithms. It is a problem with real valued state variables, which means that some kind of function approximation is required. In this paper, three reinforcement learning architectures are compared on the mountain car problem. Comparison results are presented, indicating the potentials of the actor-only approach. The function approximation modules used are based on NeuroFAST (Neuro-Fuzzy ART-Based Structure and Parameter Learning TSK Model). NeuroFAST is a neuro-fuzzy modelling algorithm, with well-proven function approximation capabilities, and features the functional reasoning method (the Takagi-Sugeno-Kang fuzzy model), Fuzzy ART concepts and specific techniques.
منابع مشابه
A Self-Generating Neuro-Fuzzy System Through Reinforcements
In this paper, a novel self-generating neuro-fuzzy system through reinforcements is proposed. Not only the weights of the network but also the architecture of the whole network are all learned through reinforcement learning. The proposed neuro-fuzzy system is applied to the inverted pendulum system to demonstrate its performance. Key-words: reinforcement learning, neural network, neuro-fuzzy sy...
متن کاملQ-Value Based Particle Swarm Optimization for Reinforcement Neuro- Fuzzy System Design
This paper proposes a combination of particle swarm optimization (PSO) and Q-value based safe reinforcement learning scheme for neuro-fuzzy systems (NFS). The proposed Q-value based particle swarm optimization (QPSO) fulfills PSO-based NFS with reinforcement learning; that is, it provides PSO-based NFS an alternative to learn optimal control policies under environments where only weak reinforce...
متن کاملAdaptive neuro-fuzzy modeling applied to policy gradient reinforcement learning
-Function approximation has been used extensively with rein forcement learning, even though theoretical support was based mainly on tabular representations. This paper proposes an actor-critic structure following the existing convergence proofs as much as possible. The actor and critic modules employ an adaptive neuro-fuzzy architecture based on fuzzy ARTMAP concepts and gradient descent. Resul...
متن کاملHierarchical Neuro-Fuzzy Systems Part II
This paper describes a new class of neuro-fuzzy models, called Reinforcement Learning Hierarchical NeuroFuzzy Systems (RL-HNF). These models employ the BSP (Binary Space Partitioning) and Politree partitioning of the input space [Chrysanthou,1992] and have been developed in order to bypass traditional drawbacks of neuro-fuzzy systems: the reduced number of allowed inputs and the poor capacity t...
متن کاملNeuro-Fuzzy Techniques under MATLAB/SIMULINK Applied to a Real Plant
The design and optimization process of fuzzy controllers can be supported by learning techniques derived from neural networks. Such approaches are usually called neuro-fuzzy systems. In this paper, we describe the application of an updated version of the neuro-fuzzy model NEFCON to a real plant. The NEFCON model is able to learn and optimize the rulebase of a Mamdani-type fuzzy controller onlin...
متن کامل